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Summary 


The  research  reported  herein,  which  has  been  supported  by  the  Air  Force  Office  for 
Scientific  Research  under  Grant  No,  AF/F49620-00- 1  -0078,  has  led  to  the  develop¬ 
ment  of  theory  and  tools  for  high  resolution  spectral  analysis  of  signals — impacting 
upon  sensor  technology  and  upon  application  areas  such  as  radar  and  medical  imaging. 
Parallel  reseaeh,  conducted  under  the  same  AFOSR  support,  has  also  led  to  new  results 
in  Robust  and  Optimal  control  for  certain  types  of  nonlinear  and  oscillatory  systems. 

The  main  thrust  of  the  research  has  been  on  the  subject  of  high  resolution  spectral 
analysis.  The  advances  we  report  on  are  a  culmination  of  efforts  by  the  PI  and  his 
co-workers  over  a  number  of  years.  The  key  elements  are: 

1 .  The  discovery  that  (weighted)  covariance  statistics,  i.e.,  statistics  which  are  more 
general  than  the  traditional  autocorrelation  function,  allow  for  a  superior  resolu¬ 
tion  of  the  power  spectrum  of  a  time-series. 

2.  The  development  of  a  computational  theory  for  parametrizing  all  power  spectra 
of  bounded  complexity,  which  are  consistent  with  given  statistics  of  a  time  series. 

3.  The  development  of  an  approximation  theory  for  incorporating  prior  informa¬ 
tion  on  the  power  spectrum,  and  for  fusion  of  data  in  the  form  second  order 
statistics  which  have  been  obtained  by  different  sensors. 

A  U.S.  Patent  (No.  6,400,310  issued  June  4,  2002)  has  been  issued  to  the  PI  and  his 
co-workers  (Chris  Byrnes  and  Anders  Lindquist)  on  related  technology  for  application 
to  speech  analysis  and  to  the  analysis  of  radar  signals.  The  theory  and  methodolo¬ 
gies  developed  under  the  grant  are  expected  to  have  a  major  impact  in  applications 
such  as  estimation  of  direction-of-arrival  in  radar  and  sonar,  synthetic  aperture  radar, 
beamforming  and  antena  focusing,  as  well  as  speech  recognition  and  speech  synthesis. 

The  research  supported  by  the  present  grant  resulted  in  10  journal  papers,  6  book 
chapters,  9  conference  papers,  one  Ph.D.  thesis  and  one  M.S.  thesis.  These  are  are 
listed  below. 
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1  Research  Publications 


The  research  supported  by  the  present  grant  resulted  in  10  journal  papers,  6  book  chap¬ 
ters,  9  conference  papers,  one  Ph.D.  thesis  and  one  M.3,  thesis.  These  are  are  listed 
below.  They  can  be  classified  broadly  into  categories  as  follows: 

High  resolution  spectral  analysis:  2,6,7,8,10,11,14,15,16,17,18,22,24,25,27. 

Convex  optimization  and  distance  measures  for  power  spectra:  10,14,15. 

Mixing/fusion  of  statistics:  15,16. 

Imaging  techniques:  13,22. 

Analytic  interpolation  theory/applications:  1,6. 

Robust  control:  3,4,6,19,20,21,23,2 6. 

Sampled-data  control:  12. 

Journal  publications 

1 .  T.T.  Georgiou,  “Analytic  Interpolation  and  the  Degree  Constraint,”  Ini.  J  Applied 
Mathematics  and  Computer  Science ,  Special  issue,  guest  editors  M.  Fliess  and 
A.  El  Jai,  January  2001,  vol.  11,  No  1,101-109. 

2.  T.T.  Georgiou,  “Spectral  Estimation  by  Selective  Harmonic  Amplification,”  IEEE 
Trans ,  on  Automatic  Control ,  46(1):  29-42,  January  2001. 

3.  S.  Varigonda  and  T.T,  Georgiou,  “Oscillations  in  Systems  with  Relay  Hystere¬ 
sis,”  IEEE  Trans .  on  Automatic  Control ,  46(1):  65-77,  January  2001. 

4.  T.T.  Georgiou  and  M.C.  Smith,  “Remarks  on  “Robustness  Analysis  of  Nonlin¬ 
ear  Feedback  Systems  An  Input-Output  Approach,”  IEEE  Trans ,  on  Automatic 
Control ,  46(1):  171-172,  January  2001 . 

5.  U.  Walther,  T.T.  Georgiou  and  A,  Tannenbaum,  “On  the  Computation  of  Switch¬ 
ing  Surfaces  in  Optimal  Control:  A  Groebner  Basis  Approach,”  IEEE  Trans .  on 
Automatic  Control ,  April  2001. 

6.  C.  Byrnes,  T.T.  Georgiou,  and  A.  Lindquist,  “A  Generalized  Entropy  Criterion 
for  Nevanlinna-Pick  Interpolation:  A  Convex  Optimization  Approach  to  certain 
problems  in  Systems  and  Control”,  IEEE  Trans .  on  Automatic  Control ,  45(6): 
822-839,  June  2001, 

7.  T.T.  Georgiou,  “The  Structure  of  State  Covariances  and  its  relation  to  the  Power 
Spectrum  of  the  Input,”  IEEE  Trans .  on  Automatic  Control ,  47(7):  1056-1066, 
July  2002. 

8.  T.T.  Georgiou,  “Spectral  Analysis  based  on  the  State  Covariance:  the  Maximum 
Entropy  Spectrum  and  Linear  Fractional  Parameterization,”  IEEE  Trans .  on  Au¬ 
tomatic  Control ,  pages  1811  -1823,  November  2002. 
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9.  S.  Varigonda,  XT,  Georgiou,  and  R  Daoutidis,  “Numerical  Solution  of  the  Op¬ 
timal  Periodic  Control  Problem  using  Differential  Flatness”  IEEE  Trans .  on 
Automatic  Control^  to  appear,  2003, 

10.  T.T.  Georgiou  and  A.  Lindquist,  “Kullback-Leibler  Approximation  of  Spectral 
Density  Functions”  IEEE  Trans ,  on  Information  Theory ,  to  appear,  2003. 

Book  Chapters 

11.  C.  I.  Byrnes,  T.  T,  Georgiou  and  A.  Lindquist,  “Advances  in  high-resolution 
spectral  estimation,”  System  Theory:  Modeling,  Analysis  and  Control,T.E.  Djaferis 
and  I.C.  Schick  (editors),  Kluwer  Academic  Publishers,  2000, 167-179. 

12.  IJ.  Fialho  and  T.T.  Georgiou,  “Chapter  7:  Computational  Algorithms  for  Sparse 
Optimal  Digital  Controller  Realizations,”  in  Digital  Controller  Implementation 
and  Fragility:  A  Modern  Perspective ,  Robert  SH  Istepanian  <&  James  F  Whid- 
borne  (editors)  Springer- Verlag,  2001. 

1 3 .  T.T.  Georgiou,  P.  J,  01  ver,  and  A.  Tannenbaum,  “Maximal  entropy  for  reconstruc¬ 
tion  of  back  projection  images,”  ”IMA  Volumes  in  Mathematics  and  its  Applica¬ 
tions,”  Volume  133:  Mathematical  methods  in  computer  vision  Springer- Verlag, 
New  York,  2002. 

14.  XT.  Georgiou,  “Toeplitz  covariance  matrices  and  the  von  Neumann  relative  en¬ 
tropy,”  in  Control  and  Modeling  of  Complex  Systems:  Cybernetics  in  the  21st 
Century:  Festschrift  volume  for  Professor  H,  Kimura;  K.  Hashimoto,  Y.  Oishi, 
and  Y.  Yamamoto,  Eds.  Boston,  MA:  Birkhauser,  2003. 

15.  T.T.  Georgiou,  “Structured  covariances  and  related  approximation  questions,”  in 
Directions  in  Mathematical  Systems  Theory  and  Optimization,  Festschrift  vol¬ 
ume  for  Professor  A,  Lindquist,  Editors:  A,  Rantzer  and  C.  Byrnes,  Springer 
Verlag,  2002. 

16.  XT.  Georgiou,  “The  mixing  of  state  covariances,”  Multidisciplinary  Research 
in  Control:  The  Mohammed  Dahleh  Symposium  2002.  Eds.  L.  Giarre’  and  B. 
Bamieh,  Lecture  Notes  in  Control  and  Information  Sciences  N.  289,  Springer- 
Verlag,  Berlin,  2003. 

Refereed  Conference  Publications 

17.  T.T.  Georgiou,  “Subspace  analysis  of  covariances,”  Proceedings  of  the  IEEE 
Conf.  on  Accoustics,  Speech,  and  Signal  Processing,  Istanbul,  June  2000. 

18.  T.T.  Georgiou,  “Co-invariant  subspaces  in  array  processing,”  Proceedings  of  the 
2000  international  workshop  on  the  Mathematical  Theory  of  Networks  and  Sys¬ 
tems,  Perpignon,  France,  June  2000. 

19.  S.  Varigonda,  T.  T,  Georgiou,  R.  A.  Siegel  and  P.  Daoutidis,  "Computation  of 
optimal  periodic  control  for  chemical  processes,”  2000  AIChE  Annual  Meeting, 
November  2000,  Los  Angeles,  CA  (abstract). 
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20.  T.T.  Georgiou  and  M.C.  Smith,  “Robustness  of  a  relaxation  oscillator/1  Proceed¬ 
ings  of  the  2000  Conf  on  Decision  and  Control,  Sydney,  Australia,  December 
2000. 

21.  S.  Varigonda  and  T.T.  Georgiou,  “Global  stability  of  periodic  orbits  in  relay  feed¬ 
back  systems/1  Proceedings  of  the  2000  IEEE  Conf.  on  Decision  and  Control, 
Sydney,  Australia,  December  2000. 

22.  T.T.  Georgiou,  and  A,  Tannenbaum,  “High  Resolution  Sensing  and  Anisotropic 
Segmentation  for  S  AR  Imagery/1  Proceedings  of  the  2000  IEEE  Conf.  on  Deci¬ 
sion  and  Control,  Sydney,  Australia,  December  2000. 

23.  S.  Varigonda,  T.T.  Georgiou  and  M.  Daoutides, 11 A  flatness  based  algorithm  for 
optimal  periodic  control  problems,”  Proceedings  of  the  American  Control  Con¬ 
ference,  Arlington,  VA,  June  2001 . 

24.  T.T.  Georgiou,  “On  the  structure  of  state  covariances/1  Proceedings  of  the  2001 
IEEE  Conf.  on  Decision  and  Control,  Orlando,  FL,  December  2001 . 

25.  A.  Nasiri  Amini  and  T.T.  Georgiou,  “Statistical  analysis  of  state-covariance  subspace- 
estimation  methods,”  Proceedings  of  the  2002  IEEE  Conf.  on  Decision  and  Con¬ 
trol,  Las  Vegas,  NV,  December  2002. 

Theses 

26.  Subbarao  Varigonda,  Robust  control  of  periodic  systems  with  application  to  the 
control  of  chemical  reactors ,  Ph.D.  Thesis,  Dept,  of  Chemical  Eng.  and  Material 
Sciences,  University  of  Minnesota,  March  2001 . 

27.  A.  Nasiri- Amini,  State  Covariance  Subspace  Methods  for  Spectral  Estimation ; 

MS  Thesis,  Dept,  of  Electrical  and  Computer  Eng.  University  of  Minnesota, 
June  2003. 
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2  Accomplished  Research 


“Modem  nonlinear  methods”  for  spectral  analysis  began  their  appearance  in  the  early 
1980’s  and,  invariably,  relied  on  autocorrelation/covariance  statistics  of  a  given  time- 
series  (originating  from  speech,  radar,  sonar,  etc,).  The  goal  of  these  methods  was  to 
overcome  limitations  on  resolution  in  linear  (FFT-based)  methods  which  stem  from  the 
time-frequency  uncertainty  principle.  The  theory  and  methods  which  were  introduced 
in  the  research  reported  herein  may  be  seen  as  “post-modem”  in  that  they  are  based  on 
an  evolution  of  the  ideas  underlying  the  aforementioned  “modem  nonlinear  methods” 
of  the  1980’s  and  1990’s;  these  being  exemplified  by  the  maximum  entropy  (MEM), 
the  maximum  likelihood  (Capon)  and  various  subspace  identification  methods  (e,g., 
MUSIC,  ESPRIT). 

In  order  to  explain  the  new  Ideas  we  briefly  describe  the  basic  setting  of  the  “mod¬ 
em  nonlinear  methods”:  Denote  by  Rk  :=  E{u{i)u{£+h)}  (k  —  0, 1, . . ,)  the  autocor¬ 
relation  sequence  of  a  (zero-mean)  stochastic  process  u(k).  Typically,  this  is  estimated 
from  the  observation  record.  The  power  spectrum  in  the  simplest  case  of  a  scalar  real 
u(k ),  is: 

$„„(0)  ~  ■  •  •  +  R2e~2je  +  Rie~je  +  Rq  +  R xeje  +  R2e2je  .... 

The  one-sided  “half’  of  the  series 

fuu(z)  =  2^0  +  RlZ  +  +  .  •  • 

Is  a  central  object  in  our  theory.  It  is  now  easily  seen  how  the  standard  autocorre¬ 
lation  sequence  specifies  fuu  and  its  derivatives  at  the  origin,  i.e,,  /uti(Q)  =  \Rq, 
j^fuui 0)  =  Ru  etc.  At  the  same  time,  fuu  has  positive-real  part  (since  #uu(0)  >  0). 
In  fact  “positive  realness”  is  what  characterizes  such  “half  spectra”  and  the  autocorre¬ 
lation  statistics  lead  us  naturally  to  finding  suitable  “positive  real  interpolants”  for  the 
estimated  statistics.  Any  such  interpolant  is  a  power  spectrum  which  is  consistent  with 
our  data. 

The  “modem  nonlinear  methods”,  in  one  way  or  another,  lead  to  specific  inter¬ 
polants  for  a  partial  autocorrelation  sequence  Rq,  i£i, . . . ,  Rn.  It  should  be  noted  that, 
in  general,  there  is  a  family  of  interpolants  which  are  all  consistent  with  such  partial 
statistics.  Hence,  there  Is  a  plethora  of  “methods.”  All  such  methods  are  often  justified 
as  seeking  power  spectra  with  specific  properties  (e.g,,  maximum  entropy,  etc.). 

The  viewpoint  which  has  led  to  advances  reported  herein  can  be  explained  by  em¬ 
phasizing  the  following  facts: 

(a)  Covariance  statistics  represent  constraints  that  define  the  family  of  power  spectra 
which  are  consistent  with  our  data, 

(b)  The  size  of  this  family  represents  uncertainty  about  the  “true”  power  spectrum. 

(c)  An  “algorithm”  or  a  “method”  represents  a  specific  selection  of  a  power  spectrum 
which  is  consistent  and  (possibly)  incorporates  prior  information. 
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Each  of  these  facts  deserves  special  attention.  In  fact,  this  research  has  extended,  ex¬ 
plored,  and  integrated  the  above  so  as  to  form  the  basis  of  a  theory  for  high  resolution 
spectral  analysis. 


2,1  High  resolution  spectral  analysis 

With  regard  to  item  (a),  we  have  made  a  crucial  observation  [2]  which  forms  the  basis 
of  new  very  high  resolution  methods: 

If  the  time-series  u(k)  is  processed  by  a  first-order  filter  as  shown  in  Figure  l,then 
the  covariance  of  the  state/output  x(k)  relates  to  the  value  of  the  corresponding  “half- 
spectrum”  fuu  via 

fuu(p)  =  1-^E{x(kf}, 

Such  a  filter  could  represent  virtual  (algorithmic  processing  of  u(k))  or  actual  dynamics 
of  sensory  aparatus. 

The  significant  new  element  in  the  above  is  that  specific  information  on  fuu  can 
now  be  retrieved  via  such  “generalized  statistics  ”  Such  information  pertains  typically 
to  power  distribution  in  a  specific  harmonic  interval  Thus,  we  have  the  following 
general  approach: 

1.  construct  a  filter  bank  as  in  Figure  2,  with  poles  selected  so  as  to  “magnify”  the 
effect  of  spectral  power  of  the  input  In  a  targeted  harmonic  Interval, 

2.  obtain  state  statistics  and  Interpret  these  as  interpolation  data  for  the  “half-spectrum” 
fuu  in  the  vicinity  of  the  frequency  band  of  interest,  and  then 

3.  derive  suitable  spectral  estimates  §UU9  e.g.,  by  using  general  analytic  interpola¬ 
tion  theory  Identifying  an  “interpolant”  fuu  and  setting  =  2Refuu . 


G(z)  —  - 

X 

\  )  z—p 

Figure  1:  First-order  filter. 

A  more  general  senario,  which  incorporates  ordinary  autocorrelation/covariance 
data  as  a  special  case,  is  possible.  To  this  end  we  may  consider  a  general  linear  structure 
for  the  processing  aparatus  (filter  bank).  In  this  case  we  take  x  =  (xi , , . . ,  xn)  the  state 
of  the  state  of  a  linear  filter 


x(k)  =  Ax(k  —  1)  +  Bu(k ), 
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Figure  2:  Bank  of  filters. 


The  filter  parameters  A ,  B  could  model  a  combination  of  actual  dynamics  (dynamics 
of  a  sensory  aparatus  or  of  the  mechanism  generating  observed  quantities)  as  well  as 
virtual  dynamics  (representing  algorithmic  post  processing  of  u(k )).  The  state  covari¬ 
ance 

E  :=  E{x(k)x(k)f} 

has  a  special  structure  inherited  by  a  combination  of  the  filter  dynamics  and  of  the 
spectral  content  of  u(k).  For  instance,  the  case  of  an  ordinary  partial  autocorrelation 
sequence  corresponds  to  choosing  the  parameters  A,  B  as  the  state  matrices  of  a  tapped 
delay  line  where  xn(k)  =  u(k)  and  for  £  =  1, . ,  * ,  n  -  1,  xt(k)  =  xt+i.  In  that  case, 
E  is  simply  an  ordinary  Toeplitz  matrix  [Rk-m]^  m=1. 

The  relevant  mathematical  theory  has  been  fully  developed  in  [1 1—14].  Briefly,  the 
covariance  matrix  E  is  characterized  by  the  condition 


rank 


E  -  AEA* 
B* 


B 

0 


=  2rank(£). 


The  above  formula  applies  to  the  general  case  where  u(k)  is  vectorial  (and  A,  B  are 
sized  accordingly).  This  condition  is  necessary  and  sufficient  for  the  solvability  of 


E  -  AEA*  =  BH  +  H*B* 


for  some  matrix  H  of  compatible  dimensions.  In  fact,  H  encapsulates  the  spectral 
power  within  the  bandwidth  of  the  input-to-state  filter  with  parameters  (A,  B),  In 
[1 1-14],  explicit  formulae  have  been  given  for: 


L  Parametrizing  the  whole  family  of  power  spectra  that  are  consistent  with  the 
“generalized  statistics”  E  (e.g.,  see  [14,  page  1818,  Theorem  2]  and  also  [13, 
Theorem  2]).  The  parametrization,  besides  being  of  theoretical  interest,  can  be 
used  to  obtain  algorithms/methods  for  constructing  power  spectra  consistent  with 
specific  prior  information. 

2.  Algorithms  and  methods  analogous  to  the  classical  Maximum  Entropy,  Capon, 
and  Subspace  identification  techniques,  but  based  on  generalized  statistics  in¬ 
stead,  have  been  developed  and  tested  on  a  variety  of  case  studies  in  [11, 14], 
and  [12,  Sections  IV,  V,  VI,  and  VII]. 
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The  selection  of  filter  parameters  A,  Bf  when  such  parameters  represent  virtual/algorithmic 
dynamics,  is  discussed  in  [12,  Section  VIII]  and  also  in  [22],  In  particular,  [22]  dis¬ 
cusses  tradoffs  between  resolution  of  a  spectral  estimator  (interpolant)  and  its  own 
variance.  This  is  an  important  issue  which  stems  from  the  fact  that  generalized  covari¬ 
ance  statistics  are  computed  based  on  a  finite  observation  record  and  the  variance  of 
the  “generalized  covariance”  estimates  is  passed  on  to  the  interpolant  and  hence,  to  the 
corresponding  power  spectrum  as  well. 


2.2  Convex  optimization  &  distance  measures 

Analytic  interpolation  has  its  origins  in  the  so-called  moment  problem  where  a  distri¬ 
bution  p  is  sought  to  match  given  moments 


Rk  =  J  gk(0)dn(9), 

with  gk  given  basis  functions.  It  is  easy  to  recognize  gk(9)  =  eike  an ddfj,(6)  =  $uu(<?) 
for  the  case  where  Rk  are  autocorrelation/covariance  samples  and  dp  a  spectral  distri¬ 
bution  of  the  stochastic  process  u(k).  The  more  general  case  of  generalized  statistics 
S  introduced  aboove,  leads  to  an  analogous  expression: 

H=  j  G(eje)dp($) 

J  —  7T 

where  G{z)  =  (/  —  zA)~lB,  and  H  obtained  from  E  via  solving  E  —  AEA*  = 
BH  T-  H*B* ;  see  [13].  In  this  latter  formulation  the  entries  of  H  represent  moments  of 
the  spectral  distribution  with  respect  to  generalized  kernel  functions  which  are  precisely 
the  entries  of  G(z). 

A  long  standing  problem  (introduced  in  [6-8]  and  motivated  by  work  of  D.C. 
Youla  in  circuit  theory  and  R.E,  Kalman  in  stochastic  realization)  called  for  the  explicit 
parametrization  of  distributions  dp  of  bounded  complexity.  The  notion  of  complexity 
can  be  conveniently  expressed  in  the  form  of  a  degree  constraint  on  the  spectral  den¬ 
sity  function  <&uu  [8].  This  problem  has  been  solved  in  [1,2, 9, 10]  for  the  general 
case  where  interpolation  data  are  given  in  the  form  of  a  state  covariance  E.  On-going 
work  [3]  explores  mathematical  extensions  to  generalized  analytic  interpolation  with 
complexity  constraint  for  the  case  where  the  input-to-state  filter  G(z)  =  (I  —  zA)~1B 
is  oo-dimensional  (i.e.,  when  A,  B  are  no  longer  finite  matrices). 

•The  relevance  of  the  work  in  spectral  analysis  stems  from  the  fact  that  the  degree 
constraint  restricts  in  a  natural  way  the  set  of  admissible  spectra,  and  thereby,  restricts 
the  uncertainty  about  the  “true”  power  spectrum  (see  [1,2]). 

In  an  effort  to  devise  algorithmic  tools  for  computing  bounded  complexity  solu¬ 
tions,  a  certain  convex  functional  was  introduced  which  initially  wFas  considered  only 
as  a  technical  tool  (  [1,4]).  It  gradually  became  clear  that  this  functional  can  be  re¬ 
interpreted  as  a  relative  entropy  between  power  spectra.  This  was  pursued  in  [18] 
whereas  analogous  functionals  have  been  explored  in  [16, 17]  for  addressing  numeri¬ 
cal  issues  of  estimating  admissible  state  covariances  from  an  observation  record.  We 
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briefly  describe  the  main  findings  which  are  fully  documented  in  the  aforementioned 
publications.  Given  two  power  spectral  density  functions  #  define  as  a  distance 
measure  between  the  two  via  the  expression 

I($,  $)  :=  J  $  (log($)  -  log(tf))  d6. 

This  quantity  is  reminiscent  of  the  Kullback-Leibler  distance  between  probability  dis¬ 
tribution  functions,  and  in  fact,  for  spectral  density  functions  it  of  course  has  similar 
convexity  properties.  Thus,  it  can  serve  a  bona  fide  distance  measure  (see  [18])  and 
moreover,  the  (oo-dimensional)  optimization  problem 


min{I(^,  over 


J  G(ej6)$(0)dd  =  H] 


has  a  unique  solution  which  can  be  expressed  in  closed  form  in  terms  of  the  data 
A,  By  H  (H  obtained  from  a  state  covariance  E  as  before)  and  a  matrix  A  (of  La¬ 
grange  multipliers  and  of  the  same  size  as  E)  which  can  be  obtained  by  solving  a 
finite-dimensional  convex  optimization  problem . 

During  case  studies,  we  often  encountered  a  situation  where  the  estimated  statistics 
E  failed  to  satisfy  E  —  AT,  A*  =  BH  4-  H*B*  (as  predicted  by  the  theory)  due  to  esti¬ 
mation  errors.  The  consequence  of  errors  introduced  in  the  process  become  significant. 
In  such  cases,  we  have  found  that  the  following  functional  which  was  introduced  by  von 
Neumann  for  measuring  distance  between  density  matrices  of  quantum  systems  [23] 

I(E,  E)  :=  trace{E(log  E  —  log  E)} 


can  similarly  serve  as  a  distance  measure  between  covariance  matrices,  and  the  relevant 
optimization  problem 

min  jl(E,  E)  :  E  such  that  E  -  AT, A*  =  BH  +  H*B*  for  some  ff}  , 


where  E  is  the  sample  state-covariance,  is  well-behaved.  This  is  documented  in  [16, 
17]. 


2.3  Mixing/fusion  of  statistics 

Data  acquisition  and  integration,  in  general,  present  a  number  of  challenging  issues.  In 
the  context  of  spectral  analysis  based  on  second  order  statistics,  it  is  often  important  to 
integrate  data  originating  from  different  sensors  (e.g.,  different  antena  arrays).  Results 
relevant  to  certain  special  but  common  situation  have  been  documented  in  [15]. 

2.4  Imaging  techniques 

In  [24]  a  new  methodology  has  been  presented  for  high  resolution  image  processing 
and  knowledge-based  segmentation  for  SAR  imagery.  We  expect  that  the  viewpoint 
advanced  wil  have  a  major  impact  on  problems  in  radar  and  remote  sensing. 
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2,5  Analytic  interpolation  theory 

As  explained  and  discussed  in  Subsection  2,2,  results  in  [1,2,9]  have  solved  a  long 
standing  problem  in  mathematics  (introduced  in  [6-8]  and  motivated  by  work  of  D.C. 
Youla  in  circuit  theory  and  R.E.  Kalman  in  stochastic  realization). 


2.6  Robust  and  Sampled-data  control 

The  problem  of  how  to  organize  computations  in  a  digital  controller  implementation  is 
often  overlooked.  In  [25]  we  document  results  and  quantitive  measures  of  robustness 
which  may  serve  as  a  guideline  for  selecting  one  particular  controller  implementation 
over  another.  References  [27,30-33,35]  document  results  on  robustness  of  oscillatory 
systems  as  well  as  a  new  methodology  for  design  of  optimal  periodic  control. 

References  [29]  and  [26]  present  two  different  applications  of  the  modem  algebra- 
geometric  tools  of  Groebner  bases  to  time-optimal  control  and  back-projection  im¬ 
age  reconstmction,  respectively.  Interest  In  Groebner  bases  stems  from  the  ease  with 
which,  closed  form  solutions  can  be  obtained  In  certain  classes  of  suitably  formulated 
problems.  Work  along  these  topics  is  on-going. 


2.7  Application  studies 

Application  studies  are  reported  in  [5, 19,21,24].  The  work  reported  therein  focuses 
on  the  use  of  the  high  resolution  methods  that  have  been  developed  in  this  research,  in 
the  context  of  speech  analysis  [5, 19],  in  non-invasive  temperature  sensing  for  medical 
applications  (e.g.,  non-invasive  heat  treatment  of  cancer)  [21],  and  in  Synthetic  Aper¬ 
ture  imaging  [24],  Below;  a  brief  outline  of  how  the  methods  apply  to  SAR  imaging  is 
given.  Details  have  been  documented  in  the  aforementioned  publications. 

SAR  imaging  Is  a  mature  subject  with  a  history  and  technological  developments 
of  over  40  years.  A  classical  text  on  the  subject  is  [37]  to  wdiich  the  Interested  reader 
is  refered  to  for  a  detail  discussion  of  enabling  technology  and  a  wide  range  of  ap¬ 
plications.  Extensive  amount  of  SAR  data,  documentation  and  technology  are  avail¬ 
able,  e.g.,  [36],  SAR  data  are  typically  collected  by  a  flying  system  (satelite,  plane) 
as  depicted  in  Figure  1,  see  [36,37,40].  The  target  area  Is  illuminated  by  a  series  of 
electromagnetic  pulses.  The  recorded  echoes  are  analyzed  into  components  according 
to  the  distance  of  the  responsible  scatterers  (e.g.,  using  matched  filtering).  The  echoes 
from  a  particular  distance  range  contain  information  about  the  profile  and  reflectivity 
of  the  relevant  scatterers  at  that  range.  The  information  is  encoded  in  the  amplitude 
and  the  floppier  shift  of  the  reflected  signal.  E.g.,  positive  floppier  shift  indicates  a 
scatterer  which  is  positioned  more  aft,  etc.  Spectral  analysis  of  the  echoed  signal  into 
Fourier  components  produces  the  amplitude  and' position  of  scatterers  at  each  distance 
range — thereby  generating  a  SAR  image  of  the  targeted  area. 
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Analogous  issues  arise  in  sonar  or  radar  applications  which  involve  array  of  sensors 
[38],  A  target  area  is  illuminated  and  the  direction  of  the  reflected  wave,  as  it  impinges 
upon  an  antenna  array,  reveals  the  location  of  the  scatterers.  The  spacial  harmonics 
of  the  received  signal  across  the  elements  of  the  antenna  carry  the  useful  information 
which  may  allow  resolving  the  location  of  nearby  scatterers. 

Application  of  the  new  techniques  for  very  high  resolution  spectral  analysis  and 
their  relevance  and  performance  when  applied  to  SAR  data  are  discussed  in  [24]  along 
with  a  explanation  on  a  novel  approach  for  subsequent  processing  of  SAR  images  us¬ 
ing  knowledge  based  segmentation  and  anisotropic  smoothing.  The  high  resolution 
methods  are  reminiscent  of  the  so-called  beamspace  techniques  [39]  and  are  based  on 
post  processing  of  SAR  data  through  a  bank  of  input-to-state  filters  (as  explained  above 
and  as  detailed  in  e,g,,  [12, 14]).  Each  input-to-state  filter  is  designed  so  as  to  achieve 
superior  resolution  in  a  partial  spacial  sector  of  the  image.  In  the  case  of  the  images 
shown  below  the  analog  of  the  method  of  ESPRIT  (as  explained  in  detail  in  [12])  has 
been  applied.  This  method  produces  a  collection  of  spectral  lines  within  the  relevant 
spacial  sectors;  these  lines  correspond  to  individual  scatterers  of  the  SAR  illuminating 
signal.  The  image  is  then  pasted  together  by  superimposing  those  individual  scatterers 
identified  in  each  sector. 

Two  images  (of  a  T-72  tank  using  MSTAR  data)  are  shown  for  comparison.  The 
first  Image  is  generated  using  standard  FFT-based  technique,  while  the  second,  using 
high  resolution  ESPRIT-like  method  (as  just  noted).  Next  to  each  of  the  two  images, 
the  outline  of  the  “target”  is  shown  which  has  been  highlighted  using  a  standard  (Mat- 
lab  signal  processing  toolbox)  edge  detection  technique.  This  last  step  underscores  the 
difference  in  dynamical  range  between  the  two,  which  facilitates  greatly  target  recog¬ 
nition  and  identification. 
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FFT-based  image  reconstruction  and  edge  detection 


high  resolution  imaging  and  edge  detection 


A  detailed  exposition  of  theory  and  computational  issues  underlying  the  new  tech¬ 
niques  has  been  documented  in  the  cited  publications. 
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